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Abstract 

Background: Virtually all low- and middle-income countries are dependent on the World Health Organization's 
Expanded Program on Immunization for delivery of vaccines to children. The Expanded Program on Immunization 
delivers routine immunization services from health facilities free of charge. Understanding interventions for 
improving immunization coverage remains key in achieving universal childhood immunization. 

Methods: We will conduct a systematic review that aims to assess the effectiveness of the full range of potential 
interventions to improve routine immunization coverage in children in low- and middle-income countries. We will 
include intervention studies, as well as observational studies. We will search the Cochrane Database of Systematic 
Reviews (CDSR), Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, EMBASE, electronic databases 
for eligible studies published by 31 August 2013. At least two authors will independently screen search outputs, 
select studies, extract data and assess the risk of bias (using separate criteria for interventions and observational 
studies); resolving any disagreements by discussion and consensus. The use of logic models and the Cochrane 
Complexity Matrix will be explored in order to better understand and contextualize studies. We will express the 
result of each study as a risk ratio with its corresponding 95% confidence intervals for dichotomous data, or mean 
difference with its standard deviation for continuous data. We will conduct meta-analysis for the same type of 
participants, interventions, study designs, and outcome measures where homogeneity of data allows. Use of harvest 
plots may be explored as an alternative. Heterogeneity will be assessed using the x 2 test of heterogeneity, and 
quantified using the I 2 statistic. This protocol has not been registered with PROSPERO. 

Discussion: This review will allow us to document evidence across a broad range of intervention types for 
improving routine immunization coverage in children and also distinguish between those that are well supported 
by evidence (to direct policy recommendations) and those that are not well supported (to direct research agenda). 
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Background 

Following the successful eradication of smallpox, the 
World Health Organization (WHO) launched the Ex- 
panded Program on Immunization (EPI) in 1974 with 
the hope of achieving 80% coverage of children less than 
1 year of age with vaccines against six major causes of 
death among children (measles, diphtheria, tetanus, 
polio, tuberculosis and pertussis) by 1990 [1,2]. Virtually 
all low- and middle-income countries (LMICs) are 
dependent on EPI for delivery of vaccines to children. 
EPI delivers routine immunization services from health 
facilities free of charge. 'Routine immunization' services 
rely on residents going to fixed sites to receive a service 
that is offered regularly throughout the year. Routine 
immunization services may also include mobile teams, 
which take services at regular intervals to populations 
without nearby health centers; and 'outreach activities' 
which reach out regularly to the community to provide a 
service or retrieve defaulters [3]. 

While routine immunization schedules may vary by 
country, the vaccines shown in Table 1 are recom- 
mended by WHO. Some vaccines such as those against 
measles, diphtheria, tetanus and pertussis are recom- 
mended for all children; others such as those against yel- 
low fever and Japanese encephalitis are recommended 
only for children residing in areas where such diseases 
are endemic; and others such as cholera and typhoid 
vaccines are recommended for children in some high- 
risk populations. In addition, some vaccines are given as 
combination vaccines such as the pentavalent vaccine 
against diphtheria, tetanus, pertussis, hepatitis B (Hep B) 
and Haemophilus influenzae type b (Hib). 

Coverage with three doses of the diphtheria- tetanus - 
pertussis vaccine (DTP3) by 1 year of age is widely ac- 
cepted as a proxy for measuring overall EPI performance. 
In 2011, global DTP3 coverage reached 83%. However, 
Africa lagged behind and coverage reached only 74% 
[4]. Poor vaccination coverage in LMICs has been attrib- 
uted to several reasons associated with immunization sys- 
tems, parental attitude and knowledge, communication 
and information, and family characteristics [5-8]. There- 
fore, interventions for improving childhood immunization 
coverage may target parents and caregivers in the commu- 
nity, the service provider, the health system, or a unique 
combination of any of these. Interventions for improv- 
ing childhood immunization coverage in LMICs have 
recently been assessed in a systematic review [9]. How- 
ever, only randomized controlled trials (RCTs), non- 
randomized controlled trials (NRCTs) and interrupted 
time series (ITS) studies were eligible for inclusion in 
the review, and only six studies met the inclusion 
criteria. As not all health systems interventions lend 
themselves to being investigated through RCTs, it is 
important to look beyond these study designs of high 



Table 1 Vaccines recommended for children by the World 
Health Organization (WHO) typically given in low- and 



middle-income countries (LMICs) 3 
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Doses 
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HepB b 
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Birth, 6, 10, 14 
weeks 


4 weeks 


Hib 


3 


6, 10, 14 weeks 


4 weeks 


PCV 


3 


6, 10, 14 weeks 


4 weeks 


RV C 


2/3 


6, 10, 14 weeks 


4 weeks 


Measles 


1 


9 months 


Not applicable 


Rubella d 


1 


9 or 12 months 


Not applicable 


Yellow fever 


1 


9 months 


Not applicable 


Vitamin A 


2 


9, 15 months 


6 months 


HPV e 


3 


9 to 1 3 years 


Variable 


Meningococca f 


1/2 


>9 months 


Variable 


Japanese encephalitis 9 


1/2 


9 to 12 months 


4 weeks 



a Full list of recommended vaccines here: http://www.who.int/immunization/ 
policy/lmmunization_routine_table2.pdf. 

b Some countries have a policy of giving a birth dose of the hepatitis 
B vaccine. 

c There are two types of licensed rotavirus vaccines, Rotateq and Rotarix. 
Rotarix is given in two doses, while a full series of Rotateq vaccination consists 
of three doses. The first dose of the rotavirus vaccine should be administered 
between 6 and 14 weeks. The maximum age for administering the last dose of 
the vaccine should be 32 weeks. 
d Minimum age for giving rubella is 6 months. 

e There are two types of licensed HPV vaccines. The quadrivalent vaccine is 
given between 9 to 13 years with a 4-week minimum interval between the 
first and second dose, and a minimum of 12 weeks between the second and 
third dose. The bivalent vaccine is given between 10 to 13 years with a max- 
imum of 2.5 months between the first and second dose. 
f There are three meningococcal vaccines available: Men A conjugate, one dose 
given between 1 and 29 years; Men C conjugate, two doses given between 2 
and 1 1 months with a minimal interval of 8 weeks between first and second 
dose, or one dose given >12 years; quadrivalent conjugate, two doses 
between 9 and 23 months, with 12 weeks between the first and second dose, 
or one dose given at >2 years. 

g There are two vaccines available: the mouse-brain-derived vaccine, two doses 
given at 1 year, with 4 weeks between first and second dose; and the live at- 
tenuated vaccine, one dose given between 9 and 12 months. 
BCG Bacille Calmette-Guerin, DTP diphtheria-tetanus-pertussis vaccine, HepB 
hepatitis B vaccine, Hib Haemophilus influenzae type b vaccine, HPV human 
papilloma virus, PCV pneumococcal conjugate vaccine, OPV oral polio vaccine, 
RV rotavirus vaccine. 

internal validity to identify other interventions of poten- 
tial relevance. 

Objectives 

We aim to assess the effectiveness of the full range of 
potential interventions to improve routine immunization 
coverage in children in LMICs. The review will address 
the question of which interventions work?' and provide 
some insight towards 'how, why, and for whom these in- 
terventions work?'. 



Machingaidze et al. Systematic Reviews 2013, 2:106 
http://www.systematicreviewsjournal.eom/content/2/1 /1 06 



Page 3 of 5 



Methods 

A logic model will be developed to help with scoping the 
review, defining and conducting the review and making the 
review relevant to policy and practice [10], using templates 
developed as part of the EU-funded INTEGRATE-HTA 
project (Anke Rohwer, personal communication). 

We will also attempt to capture the complexity of the dif- 
ferent interventions included in the review by assessing the 
following domains proposed as part of a new tool devel- 
oped within the Methodological Investigation of Cochrane 
Reviews of Complex Interventions (MICCI) project (Simon 
Lewin, personal communication): (1) number of discrete, 
active components included in the intervention compared 
with the control (or usual care); (2) number of behaviors or 
actions of intervention recipients or participants to which 
the intervention is directed; (3) number of organizational 
levels targeted by the intervention; (4) degree of flexibility 
or tailoring permitted across sites or individual intervention 
implementation/application; (5) the level of skill required 
by those delivering the intervention; and (6) the level of skill 
required for the targeted behavior when entering the study 
by those receiving the intervention (consumers, profes- 
sionals, planners) in order to meet the interventions 
objectives 

Types of studies to be included 
Intervention studies 

RCTs, cluster randomized controlled trials (cRCTs), 
NRCTs, interrupted time series studies (ITSs) and con- 
trolled before-and-after studies (CBAs) will all be included. 

Observational studies 

Uncontrolled before-and-after studies, cohort studies, 
case-control studies and cross-sectional studies will 
qualify for inclusion. 

Types of studies to be excluded 

Supplementary immunization activities such as mass 
campaigns and school-based immunization services will 
be excluded. 

Types of participants 

Participants will include: children under 10 years of age 
receiving WHO recommended vaccines through 'routine 
immunization services', pregnant women receiving tet- 
anus toxoid (TT) vaccination according to the national 
immunization schedule, caregivers of children or preg- 
nant women who are receiving the vaccines, healthcare 
workers administering the vaccines and health facilities 
or health programs providing immunization services. 

Types of interventions 

Interventions for improving routine immunization coverage 
will be categorized in the following four groups, as 



implemented in a previous systematic review [9]: (1) 
patient-oriented or community-oriented interventions, (2) 
provider-oriented interventions, (3) health-system interven- 
tions, and (4) multifaceted interventions (unique combina- 
tions of any of the above). 

Outcomes 
Primary outcome 

The primary outcome will be the proportion of children 
who have been fully immunized by the recommended 
age according to the national immunization schedule, or 
an appropriate proxy measure such as DTP3 coverage. 

Secondary outcomes 

Secondary outcomes will be identified from included stud- 
ies. These may include, but are not limited to: (1) other 
measures of immunization program performance as re- 
ported by the authors, for example, coverage with a specific 
vaccine, vaccine dropout rate, and adverse events following 
immunization (AEFI); (2) occurrence of vaccine prevent- 
able diseases (VPDs); (3) attitude and care-seeking behavior 
of caregivers towards immunization; (4) attitude and skills 
of healthcare workers; (5) characteristics of health facilities 
or health programs providing immunization services; 
(6) implementation of intervention; and (7) cost of 
intervention. 

Search strategy and sources 

The following electronic databases will be searched for 
peer-reviewed literature: Cochrane Database of Systematic 
Reviews (CDSR), Cochrane Central Register of Controlled 
Trials (CENTRAL), MEDLINE, EMBASE published by 31 
August 2013. 

A comprehensive search strategy will be developed 
that includes terms for immunization, coverage and 
immunization programs; as well as terms for children. The 
search strategy will be adapted to suit each individual data- 
base using applicable controlled vocabulary (see Additional 
file 1 for the proposed MEDLINE search strategy). 

Data collection and analysis 
Study selection 

Two authors (SM and CSW) will screen titles and ab- 
stracts of studies for potential eligibility. Following this, 
full texts of potentially eligible studies will be retrieved. 
Two authors (SM and CSW) will independently apply 
inclusion criteria to identify relevant studies to be in- 
cluded in the review. Any disagreements between the 
two authors regarding study eligibility will be resolved 
by discussion and consensus, failing which a third author 
(ER, RvK or GDH) will arbitrate. We will provide a table 
with characteristics of included studies, and another of 
excluded studies with reasons for their exclusion, in the 
final review. 
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Data extraction 

A data extraction form will be developed by consultation 
and consensus among all authors. Two authors (SM and 
CSW) will independently extract data and assess risk of bias 
in included studies, compare their results, and resolve any 
discrepancies by discussion and consensus. We plan to 
analyze the data using Review Manager (RevMan). 

Assessment of risk of bias 

The quality of studies will be assessed using the modi- 
fied GATE tool for experimental studies and the modi- 
fied GATE tool for observational studies. Details of both 
of these tools are provided in the updated NICE Public 
Health Guidance manual for 2013 [11]. 

Two authors (SM and CSW) will apply the inclusion 
criteria, and any disagreements will be resolved by dis- 
cussion and consensus; failing which we will consult a 
third author (ER, RvK or GDH). 

Measures of treatment effect and data synthesis 

We will express the result of each study as a risk ratio with 
its corresponding 95% confidence intervals for dichotom- 
ous data, or mean difference with its standard deviation for 
continuous data. We will conduct meta-analysis for the 
same type of participants, interventions, study designs, and 
outcome measures where homogeneity of data allows. We 
will use the random-effects model as the default procedure 
for meta-analyses due to anticipated heterogeneity, even if 
the latter is not statistically significant. If meta-analysis is 
not feasible due to significant statistical heterogeneity, we 
will explore the use of harvest plots. Harvest plots are a 
novel method for synthesizing evidence about the differen- 
tial effects of heterogeneous and complex interventions, 
allowing review authors to maximize the learning potential 
derived from the studies included, to tailor the characteris- 
tics of studies that are most relevant within a particular 
body of evidence, and to aid in visualizing the results [12]. 

Assessment of heterogeneity 

We will assess statistical heterogeneity using the x 2 test 
of homogeneity and quantify it using the I 2 test statistic. 
We will describe heterogeneity as high if the I 2 test stat- 
istic is greater than 50%, and will consider it statistically 
significant if the P value for the x 2 test is <0.1. If studies 
are found to be homogeneous (that is P value for the x 2 
test is >0.1), results will be pooled by random effects 
meta-analysis, stratified by study design. Subgroup ana- 
lyses will be conducted where possible, with subgroups 
defined by continent (Africa, Asia, Europe, Latin 
America and the Caribbean), setting (for example, urban 
vs rural), and vaccine delivery strategies. We will also 
tabulate heterogeneity in context and implementation 
between studies, using a new tool developed as part 



of the EU-funded INTEGRATE-HTA project (Lisa 
Pfadenhauer, personal communication). 

Assessment of reporting bias 

A funnel plot will be used to investigate the risk of pub- 
lication bias by intervention type. The funnel plot will be 
visually examined for asymmetry. Provided 10 or more 
studies are included in the analysis for each intervention 
type, we will use the Beggs-Egger test to assess for fun- 
nel plot asymmetry. 

Sensitivity analyses 

If there is sufficient data, we will conduct sensitivity ana- 
lyses to assess the effects of missing data, study design, and 
risk of bias on our primary meta-analyses. When we find a 
study with missing data, we will first perform available cases 
analysis; followed by sensitivity analyses according to impu- 
tations (that is, from assuming that all missing data are fail- 
ures to assuming that all missing data are successes). We 
will also conduct sensitivity analyses to investigate the ro- 
bustness of the results to study design (intervention vs cor- 
relation), method of meta-analysis (that is, random effects 
vs fixed effect), and risk of bias (that is, excluding studies 
with high risk of bias). 
This protocol has not been registered with PROSPERO. 



Discussion 

Expected significance of the study 

The findings of this extensive review will provide a dee- 
per understanding of not only which interventions have 
been shown to work for improving vaccination coverage 
in LMICs, but provide insight on how they work, why 
they work, and for whom these interventions work. The 
review will allow us to document evidence across a 
broad range of intervention types and also distinguish 
between those that are well supported by evidence (to 
direct policy recommendations) and those that are not 
well supported (to direct research agenda). In addition, 
understanding and documenting of study contextual fac- 
tors will allow for greater understanding of external val- 
idity through detailed assessment and facilitate better 
replication of interventions in other locations. 

With an estimated 22.4 million children reported to 
not have received the DTP3 vaccine in 2011, where 
more than 70% of these children live in 10 LMICs coun- 
tries (Afghanistan, Chad, Democratic Republic of the 
Congo, Ethiopia, India, Indonesia, Nigeria, Pakistan, 
Philippines and South Africa), identifying effective inter- 
ventions for improving vaccination coverage in LMICs 
remains key in efforts to achieve universal childhood 
immunization [4]. 
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Additional file 



Additional file 1: MEDLINE search (adapted from Oyo-lta et al. [9]). 
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